Chromomagnetic instability in two-flavor quark matter at nonzero temperature 
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We calculate the effective potential of the 2SC/g2SC phases including vector condensates ((gA G z ) 
and (gA\)) and study the gluonic phase and the single plane- wave Larkin-Ovchinnikov-Fulde-Ferrell 
state at nonzero temperature. Our analysis is performed within the framework of the gauged 
Nambu-Jona-Lasinio model. We compute potential curvatures with respect to the vector conden- 
sates and investigate the temperature dependence of the Meissner masses squared of gluons of color 
4-7 and 8 in the neutral 2SC/g2SC phases. The phase diagram is presented in the plane of tem- 
perature and coupling strength. The unstable regions for gluons 4-7 and 8 are mapped out on the 
phase diagram. We find that, apart from the case of strong coupling, the 2SC/g2SC phases at low 
temperatures are unstable against the vector condensation until the temperature reaches tens of 
MeV. 

PACS numbers: 12.38.-t, 11.30.Qc, 26.60.+C 



I. INTRODUCTION 

Sufficiently cold and dense quark matter has a rich 
phase structure; during the last decade, significant ad- 
vances have been made in our understandings of color su- 
perconductivity [I)]. At asymptotically large quark den- 
sity, studies using the perturbative one-gluon exchange 
interaction, directly based on first principles of QCD, are 
reliable and have clarified the nature of the pairing dy- 
namics of quarks. However, if the color-superconducting 
phase is realized in nature, it appears in the interior of 
compact stars. The density regime of interest is, there- 
fore, up to a few times nuclear density. The investigation 
of the ground state of quark matter in this moderate 
density regime under conditions relevant for the bulk of 
compact stars (i.e., color and electric charge neutrality 
and /3-equilibrium) has recently been of great interest 
ill- 

At the present time, it is known that the electric neu- 
trality condition plays a crucial role in the Cooper pair- 
ing dynamics in quark matter. It enforces a substan- 
tial Fermi momentum mismatch on quarks. As a con- 
sequence, the ordinary BCS state is not always ener- 
getically favored over other unconventional states with 
thepossibility of a crystalline color superconductivity 
Q and a gapless color superconductivity (e.g., the 
gapless 2SC (g2SC) phase Q and gapless color-flavor- 
locked (gCFL) phase Q). However, it turned out that the 
2SC/g2SC phases suffers from a chromomagnetic insta- 
bility, indicated by a negative Meissner masses squared 
of some gluons @. In the two-flavor case (and at zero 
temperature), gluons of adjoint color 8 have a tachyonic 
Meissner mass in the region where the gap A is less than 
the chemical potential mismatch Sfi, A/Sfx < 1. On the 
other hand, the more severe instability related to gluons 
4-7 emerges in the region A/S/j, < y/2 (i.e., not only in 
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the g2SC phase but also in the 2SC phase). The chromo- 
magnetic instability was also found in the gCFL phase 
floL ITTI . [i~2| , though the manifestation of the imaginary 
Meissner masses is different from the two-flavor case. The 
question which phase is realized in neutral quark matter 
is therefore still an open question. 

Resolving the chromomagnetic instability and clarify- 
ing the nature of ground state are pressing issues in the 
study of color superconductors (la , IbH . Ha , liH IttI . liH 
HH H3, [HI- So far, a single plane- wave Larkin- 
Ovchinnikov-Fulde-Ferrell (LOFF) state [H, H] and a 
gluonic phase [l6[ have been proposed as candidates for 
the solution to the instability in two-flavor color super- 
conductor. It is interesting to note that both phases are 
equivalent to the conventional 2SC/g2SC phases with 
vector condensates [i.e., (As) ^ for the single plane- 
wave LOFF state and (A%), (A%), (A\) ^ for the 
gluonic phase (without loss of generality)]. The neutral 
single plane-wave LOFF state is indeed free from the in- 
stability in the weak-coupling regime [H, [l7|, but still 
suffers from the instability related to gluons 4-7 in the 
intermediate- and strong-coupling regimes [l7|. In addi- 
tion, it has been indicated that a LOFF state with many 
plane waves is energetically more favored than the sin- 
gle plane- wave LOFF state Q. (Note that it has recently 
been demonstrated that, in the three- flavor LOFF 
state with realistic crystal structures has much lower free 
energy than the single plane- wave LOFF state @.) On 
the other hand, the gluonic phase could resolve the in- 
stability associated with gluons 4-7 in the intermediate- 
and the strong-coupling regimes [l6|,[22j]. However, its dy- 
namics has been clarified only around the critical point. 
It should be mentioned that a mixed phase [25| and, in 
the three-flavor case, pha ses with spontaneously induced 
meson supercurrents (26| are also candidates for the so- 
lution to the chromomagnetic instability. 

Most of the studies of the chromomagnetic instabil- 
ity have been restricted to zero temperature. However, 
in order to look at its relevance for the phase diagram, 
one has to investigate the nature of the instability at 
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nonzero temperature. To our knowledge the instability 
is weakened by thermal effects and should finally vanish 
at sufficiently high temperature [ill, E E3, El . 

In this work, we calculate the effective potential of 
the 2SC/g2SC phases including the vector condensates 
(gA®) and (gA^). The Meissner masses squared in the 
2SC/g2SC phases are computed from the curvature of the 
effective potential with respect to the vector condensates. 
The potential curvature in the direction of (gAf) and 
{gA\) corresponds to the Meissner mass squared of glu- 
ons of color 4-7 and 8, respectively. We also present the 
phase diagram in the plane of temperature and diquark 
coupling strength and map out the unstable regions for 
gluons 4-7 and 8 on the phase diagram. The results 
presented in this paper are partly overlapping with the 
previous paper [28|, but we shall take a closer look at 
the chromomagnetic instability by means of a detailed 
investigation of the effective potential. 

This paper is organized as follows. In Sec. II, we in- 
troduce the effective potential of a gauged Nambu- Jona- 
Lasinio model with vector condensates at nonzero tem- 
perature. We then derive the formulae for the Meissner 
masses squared at nonzero temperature. We present nu- 
merical results for gluons 4-7 and the 8th gluon, sepa- 
rately. We also present the phase diagram and map out 
the unstable regions on the diagram. Section III is de- 
voted to conclusions. 
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In a gauge theory, the electron chemical potential \i e 
and the color chemical potential (i$ are induced by the 
dynamics of gauge fields [2{|. The Maxwell and the 
Yang-Mills equations with the requirement of vanishing 
photon- and gluon-tadpole diagrams ensure electric and 
color neutrality. In NJL-type models, on the other hand, 
one has to impose the neutrality conditions by adjust- 
ing \i e and \i% [30| . In what follows, we neglect the 
color chemical potential because it is suppressed in the 
2SC/g2SC phases, \i % ~ C(A 2 //2) < A. 

In Nambu-Gor'kov space, the inverse full quark prop- 
agator S~ 1 (p) is written as 
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II. MEISSNER MASSES AT NONZERO 
TEMPERATURE 



Gauged Nambu— Jona-Lasinio model with 
vector condensates 
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In order to study the Meissner screening mass of glu- 
ons, we use a gauged Nambu- Jona-Lasinio (NJL) model 
with massless up and down quarks: 

C = ^j(ip+ fn°)ij + G D (in l5 ee b C$ T ) (^ T Ci l5 ee b ^) 



where the quark field ip carries flavor = 1, . 
with Nf = 2) and color (a, (3 = 1, . . . N c with N c 
indices, C is the charge conjugation matrix; (e) lfc 
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and (e ) a " — e ba " are the antisymmetric tensors in flavor 
and color spaces, respectively. The covariant derivative 
and the field-strength tensor are defined as 
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In order to evaluate loop diagrams we use a three- 
momentum cutoff A = 653.3 MeV. This specific choice 
does not affect the qualitative features of the present 
analysis. 

In /3-equilibrated neutral quark matter, the elements 
of the diagonal matrix of quark chemical potentials fi are 



Here r 3 = diag(l, —1) is a matrix in flavor space. Follow- 
ing the usual convention, we choose the diquark conden- 
sate to point in the third direction in color space. In this 
work, we are interested in the Meissner masses squared 
of gluons of color 4-7 and 8, it is sufficient to study the 
case of the nonvanishing vector condensates (gA®) ^ 
or (gAD^O fR. 

In the one-loop approximation, the effective potential 
of two-flavor quark matter (without electrons) is given 
by 
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where w„ = (2n + 1)ttT are the Matsubara frequencies 
and a G (6,8). Note that the dependence on the vector 
condensates enters through the covariant derivative in 
the quark propagator ((6|. 

The Meissner mass squared in the 2SC/g2SC phases 
can be calculated from 
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However, in order to obtain meaningful results, we have 
to subtract ultraviolet divergences from Eq. @ (see be- 
low). 



B. Meissner mass squared of gluons of color 4—7 

In this subsection we investigate the gluonic phase and 
the Meissner mass of the 6th gluon at nonzero temper- 
ature. Let us first note that, neglecting terms of order 
C(/2 2 /A 2 ) and 0(A 2 //2 2 ), one can show that the poten- 
tial curvature at zero temperature is (lrl |22T | 
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The result is consistent with the Meissner mass squared 
for gluons 4-7 derived within the hard-dense-loop (HDL) 
approximation Q. However, this is not the case for the 
Meissner mass squared calculated directly from Eq. ([H]). 
The potential curvature suffers from ultraviolet diver- 
gences oc A 2 and therefore we have to subtract them. 
At zero temperature the subtraction term is given by 
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where B = (gA & z ). (In this paper, we shall refer to the 
phase where B ^ as the gluonic phase.) 

At nonzero temperature, on the other hand, the sub- 
traction term should depend on temperature. Indeed one 
finds 

d 2 V(0, B,6n,n,T) 



dB 2 



B=0 



A 2 
12tt 2 



e 1 N F {e 1 A + e 2 fL + e 3 6fi), (12) 
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where Np(x) — l/(e x ' T +l), otherwise the Meissner mass 
in the normal phase assumes an unphysical positive value. 
Let us note that, in the case of T — ► 0, Eq. (fl"2|) is in exact 
agreement with Eq. (fTTj) . It should be also noted that the 
temperature dependence in Eq. (|12p is made redundant 
when A>T. Thus, the temperature dependence of Eq. 
(fT2")) is a cutoff artifact indeed. 

In order to investigate the phase transition from the 
gluonic phase to the 2SC/g2SC phases, we define the fol- 
lowing normalized effective potential, that corresponds 
to the subtraction IT21). 



n B = V{A, B, S/i, n, T) - 7(0, B, 5/i, [i, T). (13) 

It should be noted that, even if T — > or A 3> T, the 
effective potential (fT3"|) itself is no longer coincident with 
that in our previous paper [22j: 



■d 

a 
u 
re 
a 

in 



u 

a 




FIG. 1: The Meissner mass squared of the 6th gluon [divided 
by ft 2 /(6-K 2 )] as a function of A/5fi for T = MeV (solid), 
T — 10 MeV (dotted) T = 20 MeV (dashed), T = 30 MeV 
(dot-dashed) and T = 40 MeV (short-dashed). We used p = 
500 MeV and 5u = 80 MeV. 



If we introduce a cutoff large enough to neglect the tem- 
perature dependence in Eq. (|12|) . we can use the mass 
subtraction (|11[) and, therefore, the potential subtraction 
(fT4| . (Of course, strictly speaking, such a cutoff should 
be infinite.) However, we wish to study the qualitative 
properties of the chromomagnetic instability in the phase 
diagram at morerate density regime within the gauged 
NJL model (i.e., nonrenormalizable four-fermi interac- 
tions) , so we shall use the finite cutoff and, hence, the nor- 
malization (|13|) . Fortunately, we did not find a qualita- 
tive difference between Qb and £l' B . Here we quote quan- 
titative differences between these two normalizations at 
zero temperature: B determined from Eq. (|13p around 
the gapless onset could be 40% larger as compared to 
that in Ref. [22| and, accordingly, the free energy gained 
by B ^ could be 35% larger. 

Figure Q] shows the Meissner mass squared of the 6th 
gluon, which is given by 
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n' B = V(A, B, 8^ n, T) - 1/(0, B, 0, 0, 0). 



(14) 



At T = 0, we see the manifestation of the chromomag- 
netic instability at all values below A/Sfj. = y/2. Note 
that the critical point of the instability (A/5fi) c is some- 
what lower than \2. This is because our model param- 
eters do not correspond to the HDL limit, so the contri- 
bution from subleading logarithms ~ A 2 ln(A/A) is not 
negligibly small. We find, however, that the behavior 
of the Meissner mass squared is qualitatively consistent 
with that derived by using the HDL approximation Q . 

As T is increased, due to thermal smoothing effects, 
the characteristic kink at A/dfj, = 1 is smeared and the 
Meissner mass tends to approach its value in the nor- 
mal phase. However, its temperature dependence (at 
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FIG. 2: The free energy measured with respect the 2SC/g2SC 
phases at B = as a function of B for T = MeV (solid), 10 
MeV (dotted), 20 MeV (dashed) and 30 MeV (dot-dashed). 
We used the T-independent gap A = S/j,. Other parameters 
are the same as in Fig. [T] 



FIG. 3: The free energy measured with respect the 2SC/g2SC 
phases at B — as a function of B for T = MeV (solid), 
10 MeV (dotted), 20 MeV (dashed), 30 MeV (dot-dashed) 
and 40 MeV (short-dashed). We used the T-independent gap 
A = 0.7Sfi. Other parameters are the same as in Fig. [1] 



fixed A/5/i) is non-monotonic. One can also see that 
the Meissner mass squared at small but nonzero values 
of A/Sfi remains negative even at high temperatures. At 
T ~ 5fj,/2 ~ 40 MeV, the chromomagnetic instability re- 
lated to gluons 4-7 finally disappears and the Meissner 
mass squared turns positive at all values of A/dfi. As 
T increases further, the Meissner mass squared begins to 
go down and approaches zero. 

In Figs. and we plot the effective potential (flU|) 
measured with respect to the 2SC/g2SC phases at B = 
as a function of B for several temperatures. 

Figure [2] shows the case of A/5fi = 1 (i.e., at the onset 
of the g2SC phase). At T = 0, one clearly sees that the 
gluonic phase at B ^ is energetically more favored than 
the g2SC phase at B — 0. As T is increased, the vacuum 
expectation value (VEV) of B continuously goes to zero 
and the free energy gained by the gluonic phase also de- 
creases to zero. We observe that the second-order phase 
transition from the gluonic phase to the g2SC phase oc- 
curs at T ~ 30 MeV. It can be also seen that the potential 
curvature at B = is negative at T = 0, corresponding 
to the negative Meissner mass squared in the g2SC phase 
at T = 0. The potential curvature grows with increasing 
temperature (within the interval T = — > 30 MeV) and 
its temperature dependence agrees with the result shown 
in Fig. ED 

In Fig. [31 the same plot is shown for the case of A /Sfi = 
0.7. At this value of A/S/j,, the temperature dependence 
of the Meissner mass squared is not monotonic (see Fig. 
[T]). One can in fact see that, as temperature grows, the 
potential curvature at B — first drops and then goes up. 



On the other hand, the free energy gain monotonically 
decreases with increasing temperature. We again find 
that the second-order phase transition at T ~ 35 MeV. 

Here, we would like to make some comments. The 
phase transition from the gluonic to the 2SC/g2SC 
phases is, presumably, of second order. (Evaluating the 
effective potential at small A/5fi's with sufficient accu- 
racy is not easy and hence we cannot exclude the pos- 
sibility of a first-order transition.) If so, the Meissner 
mass squared in the 2SC/g2SC phase could be a crite- 
rion for choosing the energetically favored phase without 
calculating the free energy. 

In Fig. [31 we plot the temperature dependence of the 
critical point (A/<5/i) c where the Meissner mass becomes 
negative. It is seen that (A/Sfi) c continuously goes to 
zero at T ~ <5/i/2. We have checked the robustness of 
this relation varying model parameters and found that it 
works well as long as p, is not too small. One can also see 
that (A/8/j,) c grows slightly at low temperatures. Using 
huge values of A and fx, we confirmed that this behavior 
remains true even in the HDL limit. 



C. Meissner mass squared of gluons of color 8 

We now turn to the 8th gluon. In order to investigate 
the single plane-wave LOFF state, we use the following 
gauge transformation described in Ref. Using the 

gauge transformation ip — > ip' — exp(—iq ■ x)ip, one can 
show that the single plane-wave LOFF state whose gap 
parameter spatially oscillates like A(x) — Aexp(2i<f • x) 
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FIG. 4: The temperature dependence of the critical point 
(A/8[i)c of the chromomagnetic instability for gluons of color 
4-7 (solid) and 8 (dotted). We used the same values of p, and 
Sp as Fig. [T] 
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FIG. 6: The free energy measured with respect the 2SC/g2SC 
phases at q = as a function of q for T — MeV (solid), 10 
MeV (dotted), 20 MeV (dashed) and 30 MeV (dot-dashed). 
We used the T-independent gap A = Sp and the same values 
of p and Sp as in Fig. [T] 
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FIG. 5: The Meissner mass squared of the 8th gluon [divided 
by /2 2 /(6tt 2 )] as a function of A/Sfi for T = MeV (solid), 
T = 10 MeV (dotted) T = 20 MeV (dashed), T = 30 MeV 
(dot-dashed) and T = 40 MeV (short-dashed). We used the 
same values of p and Sp as in Fig. [1] 



is equivalent to the 2SC/g2SC phases with the Abelian 
vector condensate q = (gA 8 ) / (2\/3). 

The same argument for the normalization of the effec- 
tive potential that we made in the previous subsection 
holds also for the 8th gluon. Therefore the normalized 
effective potential for the single plane-wave LOFF state 



at nonzero temperature is 

Q q = V(A, g, 5,1, n, T) - V(0, q, 6», M , T). 



(16) 



where q = (gA 8 z ) /(2a/3). Here, we chose the third com- 
ponent of q without loss of generality. The Meissner mass 
squared in the 2SC/g2SC phases is then given by 



1 d 2 fl q (A,q,Sfi, p,T) 



l M,8 
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We have checked that the subtraction term, 



1 d 2 y(0,9,<W,T) 
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dq 2 
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q=0 



agrees with -A 2 /(97r 2 ) when T — > or A > T. 



In Fig. [5j we plot 



L M.8 



as a function of A/Sfj, for sev- 



eral temperatures. We see that 



L M,8 



at T = shows 



different behavior from that obtained by using the HDL 
approximation [9(: in particular, in the 2SC phase, m 2 M § 
is not constant and there exists an enhancement in its 
values (the value of m 2 M 8 in the HDL approximation 
should be 2/3 in Fig. [5]). This is because, in Fig. [51 
contributions from subleading logarithms have not been 
subtracted from the potential curvature. However, the 
behavior is qualitatively consistent with the HDL result 
and, furthermore, we observe a negative infinite Meissner 
mass squared at the gapless onset A/5p = 1. 

At T > 0, the negative infinite Meissner mass squared 
at the gapless onset is smeared and m 2 M 8 tends to ap- 
proach zero. However, the temperature dependence is 



6 



> 



ex 
•- 

<u 

a 

w 

v 
<u 
•- 




^ [MeV] 

FIG. 7: The free energy measured with respect the 2SC/g2SC 
phases at q — as a function of q for T = MeV (solid), 10 
MeV (dotted), 20 MeV (dashed), and 30 MeV (dot-dashed). 
We used the T- independent gap A = 1.055/1 and the same 
values of p and Sfi as in Fig. 1. 



non-monotonic. We also find a temperature-induced in- 
stability in a narrow region above A/S/i = 1. (In Fig. 
21 one can see that the critical point for the 8th gluon 
grows at low temperatures. We shall take a closer look 
at this problem later.) These same results has been ob- 
served in Ref. [ll[ . Like in the case for gluons 4-7, m 2 M 8 
at small A/<5/i's remains negative at high temperatures, 
but the instability related to the 8th gluon disappears at 
T~Sfi/2. 

In Figs. [5] and [JJ we illustrate the effective potential 
measured with respect to the 2SC/g2SC phases at q = 
as a function of q for several temperatures. 

Figure HJ corresponds to the gapless onset A/Sfi = 1. 
At T = 0, the LOFF state at q ~ 70 MeV is energet- 
ically more favored state than the g2SC phase and the 
potential curvature at q = has a cusp, corresponding to 
a negative infinite Meissner mass squared at A/Sfj, = 1. 
(The result is consistent with that reported in Ref. 
The cusp at q = is immediately smeared by tempera- 
ture effects and the Meissner mass squared takes negative 
nonzero values. As T is increased, both the VEV of q and 
the free-energy gain by the LOFF state are decreased. At 
T ~ 30 MeV, we find the second-order phase transition 
from the LOFF state to the g2SC phase. The temper- 
ature dependence of the potential curvature at q = is 
consistent with the results shown in Fig. [5] 

Figure [7] shows the temperature dependence of the ef- 
fective potential at A/Sfi — 1.05, slightly above the gap- 
less onset. In this mentioned earlier, one finds 
the instability only at T > 0. In terms of the free energy, 
the reason for the temperature-induced instability can 



be interpreted as follows. At A/S/i — 1.05, the Meiss- 
ner mass squared in the 2SC phase is positive at T = 
(see Fig. [5]). One can see that the potential curvature at 
q = is indeed positive at T = 0. However, as is clear 
from Fig. [3 there exists an energetically more favored 
state at q ^ 0, the LOFF state. Therefore, the 2SC phase 
is only metastable, though the Meissner mass squared is 
positive in this phase. (The metastable 2SC phase, sepa- 
rated from the LOFF state by a potential hump, exists in 
the region 1 < A/5[i < 1.08.) As T grows, the potential 
hump is smoothed out and, at a certain small tempera- 
ture, the 2SC phase becomes unstable against the forma- 
tion of the LOFF state. Specifically the Meissner mass 
squared turns negative at T ~ 2 MeV. At T ~ 19 MeV, 
we find a second-order phase transition from the LOFF 
state to the 2SC phase. The temperature dependence of 
the effective potential clearly explains the induced insta- 
bility. However, it is fair to say that we have found an 
unexpected growth of the critical point also for the 8th 
gluon: (A/5/j,) c grows to A/6/j, ~ 1.09. 

Before concluding this subsection, we would like to 
mention the order of the phase transition LOFF — > 
2SC/g2SC. We found a second-order phase transition in 
a wide range of A/S/i. However, it is not easy to de- 
termine the order of the transition at small A/8fi and 
around A/Sfi ~ 1.08. Hence, we do not exclude the pos- 
sibility of a first-order transition. 



D. Phase diagram in T-Ao plane 

In order to see the consequences of the present anal- 
ysis, we study the phase diagram of a two-flavor color 
superconductor. To this end, we first solve the gap equa- 
tion, 
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2SC/g2SC 

OA 

and the neutrality condition, 



on 



2SC/g2SC 



0, 



= 0, 



(19) 



(20) 



where the effective potential of the neutral 2SC/g2SC 
phases ri 2 sc/ g 2SC is given by 



n 



2SC/g2SC = ^Me + 2 ^ T Ve + "^-T 14 

+F(A,0,fy, M ,T). 



(21) 



Here, the contribution from electrons has been added to 
Eq. ©. 

In the left panel of Fig. [51 we illustrate the phase 
diagram of a neutral two-flavor color superconductor in 
the plane of T and Ao, where Ao is the value of the 
2SC gap at 5/j, = and at T = (i.e., the parameter 
Ao corresponds to the diquark coupling strength). The 
result is plotted for fi — 400 MeV, which is a value typical 
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for the interior of compact stars. The solid (dashed) line 
denotes the critical line of the phase transition between 
the normal quark phase and the g2SC phase (the g2SC 
phase and the 2SC phase). 

Let us have a look at main features of the phase dia- 
gram. One sees that qualitative features of the left panel 
of Fig. [5] are consistent with the T-fi phase diagram in 
the literature. 

In the weak-coupling regime 77 MeV < Ao < 92 MeV, 
the Fermi momentum mismatch is too large for these 
coupling strengths for diquark pairing and the system is 
in the normal quark (NQ) phase at T = 0. At T > 0, 
the mismatch of the Fermi surfaces is thermally smeared 
and, then, it opens the possibility of finding the g'2SC 
hase (see, for example, Fig. 1 in the first paper in Ref. 
and Fig. 4 in the third paper in Ref. Q). 
In the intermediate coupling regime, 92 MeV < Ao < 
134 MeV, the g2SC phase is realized at T = 0. For rel- 
atively strong coupling, 110 MeV < A < 134 MeV, the 
g2SC phase at low temperature is replaced by the 2SC 
phase at intermediate temperature. At higher tempera- 
ture, the 2SC phase is replaced by the g2SC phase again. 
It is known that this unusual behavior happens in the 
intermediately coupled two-flavor quark matter. For a 
detailed discussion, see the second paper in Ref. 0. 

For strong coupling, A > 134 MeV, the gap A in- 
creases and the 2SC phase is accordingly favored at 
T = 0. At higher temperatures, however, A is decreased 
by thermal effects and the g2SC phase becomes possible 
(cf. Fig. 6 in the third paper in Ref. [H). 

Let us now take into account the chromomagnetic in- 
stability. Combining Eqs. JTSJ) and (J2DJI with Eqs. (JTSJ) 
and (fT7|) . we calculate the Meissner masses squared and 
map out the unstable regions on the phase diagram. (It 
should be remembered that we do not solve the gap equa- 
tions for A and (gA") and the neutrality condition for 
/i e self-consistently.) 
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stability in the region 92 MeV < A < 162 MeV (see the 
upper panel of Fig. (Note that the upper boundary 
of this unstable region, An = 162 MeV, is lower than 
that quoted in Refs. [13, l22|. The reason for this dis- 
crepancy is the following: in order to find the unstable 
window, we have calculated the Meissner mass squared 
directly, whereas they used the relation (A/6/i) c = \/2, 
which is derived by using the HDL approximation. Of 
course, the discrepancy is nothing but a cutoff artifact.) 
At low temperatures, the whole g2SC phase and a part 
of the 2SC phase suffer from the instability. At T ~ 20 
MeV, the instability related to gluons 4-7 is washed out 
and the phase transition is most probably of second or- 
der. (The unstable region should disappear at T ~ S/j/2 
along the thin solid line (see Fig. 0|. As a check, let 
us assume fi e ~ 90 MeV, which roughly corresponds to 
the value of /Lt e at the zero-temperature edge of the g2SC 
window. Then we see that the relation yields T ~ 20 
MeV indeed.) 

In the right panel of Fig. [HI the unstable region for 
the 8th gluon is depicted by the enclosed region. (The 
region in which the 2SC phase is metastable is not shown 
in this figure.) In this region, the LOFF state is favorable 
to cure the instability related to the 8th gluon. 

At T = 0, as it should be, only the g2SC phase 
suffers from the instability. At T > 0, however, the 
critical point shifts to larger Ao's and the unstable re- 
gion penetrates into the 2SC phase. (This is noth- 
ing but the temperature-induced instability.) While the 
temperature-induced instability in the 2SC phase disap- 
pears at T ~ 16 MeV, the unstable region in the g2SC 
phase remains until T ~ 21 MeV. 

Overlapping the middle and the right panels of Fig. 
[SJ one can see that, apart from the case of strong cou- 
pling, the 2SC/g2SC phases at low temperature are un- 
stable. In particular, the g2SC phase suffers from a se- 
vere instability related to both gluons 4-7 and 8. (In 
Fig. [101 we illustrate the temperature dependence of the 
Meissner masses squared m? M 6 and m 2 M 8 for the cases 
of A = 80, 110, 140 MeV. It is clear that at least one 
of the the Meissner masses in the 2SC/g2SC phases is 
imaginary at low temperatures and both Meissner masses 
squared become positive at T ~ 20 MeV.) For strong cou- 
plings Ao > 162 MeV, the system gets rid of the chro- 
momagnetic instability. Note that one still finds a stable 
g2SC phase in the high-temperature region in the phase 
diagram, though the gapless structure is not significant 
at high temperature. 



III. SUMMARY AND DISCUSSION 



The region enclosed with the solid thick line in the 
middle panel of Fig. [SJ corresponds to the unstable re- 
gion where gluons 4-7 have a negative Meissner mass 
squared. In this unstable region, therefore, the glu- 
onic phase should be realized by a nonvanishing VEV 
of (gA®). At T = 0, we see the manifestation of the in- 



We studied the chromomagnctic instability in two- 
flavor quark matter at nonzero temperature. We use the 
gauged NJL model and first analyzed the curvature of 
the effective potential. Then, a temperature-dependent 
subtraction for the Meissner masses squared was intro- 
duced, so that magnetic gluons remain unscreened in the 
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normal phase. As mentioned earlier, this temperature 
dependence is indeed the cutoff artifact. In this work, 
we studied the properties of the chromomagnetic insta- 
bility in the intermediate and strong coupling regimes, 
using a phenomenological four-fermi interaction. There- 
fore, we used a temperature-dependent subtraction and, 
accordingly, the ad hoc normalization of the effective po- 
tential. It should be emphasized that, for our standard 
value of the NJL cutoff, the temperature dependence of 
the subtraction term is not negligibly small actually. 

We calculated the temperature dependence of the 
Meissner masses squared as a function of A/Sfj, and found 
that, at T ~ 6fi/2, the instability related to gluons 
4-7 and 8 is washed out at all values of A/Sfi. We 
also confirmed the temperature- induced instability (i.e., 
the growth of the critical point at T > 0) for the 8th 
gluon. In order to look at the temperature dependence 
of the Meissner masses squared, we computed not only 
the potential curvature but also the effective potential 
itself as a function of the vector condensates (gA^) and 
(gAg). Evaluating the effective potential played a crucial 
role for understanding the temperature-induced instabil- 
ity for the 8th gluon. By comparing the free energies of 
the 2SC phase and the single plane-wave LOFF state, we 
clarified that the induced instability mainly arises from 
the fact that the 2SC phase in the region slightly above 
the gapless onset is only metastable at T = 0. 

We also presented the phase diagram in the T-Aq plane 
and mapped out the unstable regions for gluons 4-7 and 
8 on the phase diagram. We found that, apart from the 
case of strong coupling, the 2SC/g2SC phases at low tem- 
peratures < 20 MeV suffer from a severe instability re- 
lated to both gluons 4-7 and 8 and a large region in the 
g2SC phase should be replaced by the vector condensed 
phases. 

In calculating the effective potential, we did not enforce 
the neutrality condition. Hence, the effective potential 
shown in Figs. El El El an d [3 might be altered by the 
neutrality constraint. The result for the LOFF state (Fig. 
[7]) should be taken as an indication that the neutral 2SC 
phase is not stable against the formation of the LOFF 
state even before A/S/j, reaches the gapless onset and that 
a first-order transition (2SC <-> LOFF) occurs at a certain 
value of A/Sfi > 1. However, they must remain true 
even if we take into account the neutrality condition. At 
T — 0, a neutral LOFF state was studied by solving the 
gap equations for A and q and the neutrality condition 
for fi e self-consistently and it was revealed that the LOFF 
state is indeed favored over the 2SC phase even above the 
gapless onset (the edge of the LOFF state with the 2SC 
phase was determined to be A = 137 MeV [l7j). In 
addition, Fig. 1 in Ref. [ItJ indicates such a first-order 
transition actually happens. At T > 0, although we did 
not examine the low-temperature effective potential of 
the LOFF state, it is likely that the first-order transition 



(2SC «-> LOFF above the gapless onset) takes place as 
long as T is not too high. 

Let us look at the right panel of Fig. [S] again. (We 
should recall that the region where the 2SC is metastable 
is not depicted in Fig. [8]) As we mentioned above, there 
exists a window where the LOFF state is energetically 
more favored than the 2SC phase, even though m 2 M 8 > 
in the 2SC phase. The actual phase boundary (2SC <-> 
LOFF), as a consequence, shifts to larger Ao's when we 
solve the set of equations self-consistently and take ac- 
count of the metastability of the 2SC phase. In addition, 
the NQ phase in the weak coupling regime will be re- 
placed by the neutral LOFF state. At T = 0, in fact, 
it was found that the neutral LOFF state exists in the 
window 63 MeV < A < 137 MeV and that it is more 
stable than the NQ phase in whole this window [I?) ■ The 
weakly coupled LOFF state survives at nonzero tempera- 
ture and, presumably, undergoes a phase transition into 
the g2SC phase or the NQ phase [27|. Then, we con- 
clude that, apart from the case of strong coupling, the 
low-temperature (< 20 MeV) region of a chromomag- 
netically stable, non color-flavor-lockcd phase has a com- 
pletely different structure from known phase diagrams. 

The most interesting remaining task is now clear: we 
have to take into account all the possible gluonic con- 
densates and calculate the free energy in a self-consistent 
manner. (In particular, we have a limited knowledge of 
the gluonic phase [H,[22j]. While suggestive, it is not suf- 
ficient for drawing a conclusion about the phase structure 
of the gluonic phase.) The resulting gluonic-condensed 
phase will be free from the chromomagnetic instability. 
Here, it should be noted that the study of the effective 
potential shows that the Meissner masses squared itself 
cannot be a criteria for choosing the ground state, in 
other words, the small- (A") expansion of the effective 
potential does not work. It is also interesting to make a 
(free energy) comparison between the gluonic-condensed 
phase and the LOFF state with realistic crystal struc- 
tures. Finally, the gluonic-condensed phase has not been 
studied in the three-flavor case, so an extension to the 
realistic three-flavor quark matter would have important 
implications for the physics of compact stars. 
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